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Indication of accuracy of quantitative analysis 



The invention relates to a medical image analysis process which utilizes 
information contained in at least one medical image, in which a quantitative evaluation is 
derived fiom tiie medical image analysis process and delivered as an output 

Modem medical imaging handling protocols increasingly allow complex and 
5 involved analysis of acquired image data to produce detemiinable quantities. For example, 
protocols exist to calculate perfusion rates for blood flow, measure the physical sizes of 
anatomical structures and assign a value to the process of gastric reflux. 

An example of such a protocol which provides quantitative results is given in 
'Automatic quantitative analysis of cardiac MR perfusion images'. Marcel Breeuwer et aL, 
10 Proceeding SPIE Medical Tmaging, vol. 4327, February 2001, San Diego, USA. This 

describes an automatic quantitative analysis method fixr evaluating blood perfiision in the 
heart muscle, or myocardium. It is known that the method sometimes produces occult 
inaccurate quantitative results. In other words, the image analysis process can produce 
quantitative results which may be clinically use&l or clinically misleading but without any 
15 indication of which of these two groups any given quantitative result Hes in. 

It is an object of the invention to provide the user of quantitative image results 
with more reliable image data. 

This is achieved according to the method of the invention whereby the result 
of an error analysis, performed in order to provide information relating to the accuracy of the 
20 quantitative evaluation, is also delivered as an output. 

The image data used by the protocol can be degmded by a variety of proces ses 
which are implicit within the data as a result of the limitations of image acquisition or 
processing. When these have a visible effect on the image they are known as arte&cts. One 
example of an arte&ct is noise, the statistical variation in voxel intensity value, which adds 
25 an intrinsically unquantifiable value to the real intensity value which is allocated to any 

particular voxel. The inrocess of image reconstruction assumes that it is possible to assign an 
exact value to this voxel intensity, whereas in reality the value assigned is always a 
composite of the real value which describes the tissue being represented by the voxel and an 
extra value ascribed to noise. When a protocol aimed at deriving quantitative results is 
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^plied to the iniage, is utilizes the intensity values designated to each voxel as basic input 
values. The noise element of the intensity value is fed into the evaluation process along with 
the part of the intensity value which represents the real tissue and the inclusion of the noise 
value feeds an error into the eventual quantitative result 

Other processes which degrade the image have a similar effect, albeit for 
different reasons, on any eventual matiiematical result For example, the partial volume 
effect, by which voxels representing tissue matter at, or near, the boundaries of tissue 
divisions characterized by different intensity values, are rendered with intensity values which 
are merely averages of the surrounding intensities. This introduces entirely spurious intensity 
values which, when fed into a quantitative evaluation process, again introduce an inaccuracy 
which is difficult to perceive. 

The processes which have an effect on the eventual image also include the 
inherent limitations of the imaging process and tihie imaging steps taken to translate that 
-^^Eocess-into a visual end rpsnlt For fixmnple, the resolutimi of the digilalJmagfi> whipl^ can — 
be thought of as the smallest object in the image which can be detected, influences any final 
quantitative result derived ftom the image. A higgler resolution is achieved in a digital image 
by displaying the image using a greater number of pixels. This spreads the overall 
information content in the image over a larger number of pixels and in the case of an image 
derived from radiation will increase the statistical fluctuation of the intensity value in each 
pixel. However, a greater resolution, and therefore a larger number of pixels, will result in 
more pixels being included in any regional contour imposed on the image for the purposes of 
quantitative analysis. This will have the result of improving the statistical fhactuation of the 
eventual quantitative result. 

These, and other artefects and contributory processes having an effect on the 
quantitative analysis, can be modeled. As a first step, the quantitative information, or data, 
which is presented as an output of the normal quantitative analysis can be modeled, either 
mathematically by using equations or by synflietically constructing data. Both of these 
procedures would be well known to those skilled in the art of medical ima^ analysis 
processes and result in the quantification of an ideal process, as it would be ff unaffected by 
arte&cts or any error introduced into the quantitative process. This ideally quantified process 
also therefore reveals a final, ideal, quantitative result representing a quantitative result as 
would be achieved if there were no artefacts in the image nor any other introduced error. 

Once this ideal quantitative analysis has been modeled and an ideal 
quantitative result produced, the next step is identify possible image artefacts and image 
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piocessmg steps and to evaluate the influence of these on the quantitative analysis or 
quantitative evaluation. Such arte&cts and image processing steps may include, as is known 
to those skilled in the art of medical image analysis, inoage resolution, noise, partial volume 
effect, sampling rate, tkae intensity behavior, subject motion, the production of outlier image, 
5 the effects of residual contrast agent, registration inaccuracies, segmentation inaccuracies and 
errors in placing contours. As will be appreciated by those skilled in the art, there may be 
other processes which affect the image data in such a way as to introduce an error into the 
quantitative process, and the invention may therefore be worked so as to incorporate those 
processes. 

10 The identified image processing steps and arte&cts are evaluated for their 

effect on the ideal quantitative result This can be by a process of mathematical modeling or 
by the use of aphantom, or by both. For example, statistical image noise, as is known to 
those skilled in the art, can easily be modeled as a standard deviation. This statistical 
variation can be added to the ideal model of the quantitative process with the result that the 

IS final quantitative result varies fiom the idea. The error introduced into the quantitative result 
has therefore been modeled. 

All the artefacts or image processing steps considered to be potentially 
influential on the final quantitative result can be likewise modeled in ways which are known 
to those skilled in the art In each case, the effect produced by the modeled process on the 

20 final quantitative result can be calculated and therefore assessed for its quantitative 
importance. 

Once this step has been completed, according to the method of the invention, 
the most important image processing steps and hnage arte&cts which contribute to the 
overall degradation of the image are identified. There are no hard and &st rules as to which, 

25 out of all the image processing steps and all of the possible image arte&cts, should be chosen. 
The number of individual influencing items considered to be ultimately important will 
depend on how reliable the user of the eventual quantitative data would like that data to be. 
This rosy also depend on the specific &ctors present in the particular quantitative process 
under evaluation. For example, noise is a fairly constant arte&ct in all images but motion 

30 arte&cts are more likely to occur in image sequences which represent internal anatomical 
motion, such as the motion of the diaphragm, say, during breathing. If the method were 
applied to the evaluation of the accuracy of simple quantitative measurement of a static 
anatomical structure, there would be little reason to include a motion arte&ct 
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Yet another example of an influencing charactenstic is intensity 
inhomogendty, which can cause image arte&cts in magnetic resonance images. Intensity 
inhomogendties originate from the inhomogeneous sensitivity proffle of receiver coils, and 
especially surfece coils. These inhomogeneities can be obsCTved as a variation in intensity 

5 across the image and causes pixels representing the same tissue type to be rendered with 
unequal intensities. The effect of intensity inhomogeneities on an analysis outcome can be 
very severe because the range of intensities used for the same particular tissue type can 
influence the correct recognition of that tissue type and therefore the tissue type boundaries in 
a contouring or segmenting procedure. 

10 Following an identification of the important processes affecting the accuracy 
of the quantitative process, the method of the invention proceeds with a more detailed 
modeling of the effects of the combination of the influencing processes. The important 
processes are now ascribed values, as is known to those skilled in the art, and fturfher 
evahiflt^^ v^^Z ^^tnhinfltinns nf values of each of the nrocesses, 

15 This modeling of the joint ejBEect of the important artefects and image 

processing steps on the model of the quantitative analysis allows a fiirther numerical 
evaluation of these for their effect on accuracy. It may be, for example, that the form of the 
quantitative analysis under consideration renders three or four particular processes amongst 
the artefacts and image processing steps as highly influencing. In such a case, the invention 

20 proceeds witii a more detailed investigation of just these three or four processes. As is known 
to those skilled in the art, all of these processes can be ascribed a range of values, but if they 
are ascribed a discrete range of values, then discrete numerical combinations of them can be 
added to the ideal quantitative model to produce another quantitative result representing, 
now, the effect of that particular combination of values of those processes on the quantitative 

25 analysis. 

The results of this analysis of inaccuracy can be stored in a look up table or 
indeed in any multi-dimCTisional table, as is known in the art, or may be stored within a 
formula. In other words, the values are stored in such a way fliat knowledge of the 
combination of values of the infhiencing processes leads to the value of the error introduced 
30 by that combination of values. The results, once accessed, can be presented to the viewer 
along with the mathematical quantitative result of the imaging analysis process. 

Knowledge of the combination of values of the influencing processes within a 
medical image analysis process can be easily determined by those skilled in the art Noise, 
for exanqple, can be easily quantified by taking a sample of a medical image where that 
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sanqple contains only noise and measuring fhe intensity values rendered in each pixel to 
calculate fhe value of the standard deviation of the variation of tbose intensity values. Values 
can, by other analytical processes, be attributed to oth^ influencing arte&cts and imagmg 
processes 1^ those skilled in the art 
5 Storage within a formula, in this case, is useful when the combinations of 

values of the influencing processes, and their resulting effect on the error within the 
quantitative analysis, can be easily modeled. When ttds is the case it has the advantage that it 
saves on the computing power which would otherwise be needed when the results are stored 
in a multi-dimensional table of high dimensional order. 

10 It is important to note that in the case of a particularly simple quantitative 

analysis, it may be possible to perform the error analysis and calculation during the 
quantitative analysis itself This may be possible, for example, when there is only one 
influencing process, say noise, and this can be analyzed and evaluated during the original 
imaging process itself. In such a case, storage may not be necessary. It is also possible that 

IS only a single error result could be handled and delivered by the method of the invention as an 
output 

An important point to be aware of is that all these diverse effects on the 
quantitative content of a medical image can be appreciated qualitatively by any user with a 
good understanding of the physical processes behind medical imaging, but cannot be 

20 accurately perceived on an individual case by case basis. In other words, we can say with 

some degree of certainty that the noise in an image has contributed to the inaccuracy of some 
mathematical quantity extracted from the image, but we cannot assess the exact quantitative 
effect just by looking at the image. Similarly, we can understand that partial volume effect 
may have introduced an inaccuracy into a consequential quantitative result but are completely 

25 unable to tell by looking if indeed it has or what the quantitative effect might be. 

The invention provides the user with more reliable image data because it 
solves the problem of how to assess the accuracy of quantitative results which are dependent 
on the medical images. Quantitative results which are derived from medical images are based 
on Ifae contents of the medical image data and such data content is visually comply and 

30 difiBcult for the eye to assess. Early medical images were developed directiy onto hard copy 
and viewed by the user, so any analysis of the image was restricted to a qualitative 
assessment only. The advent of digitization and the appUcation of modem digital data 
handling to medical imaging has placed the viewer in an imparalleled position in the history 
of medical evaluation. The user is now in a position to analyze the information content of the 
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medical images with which he is presented and extract quantitative values. But medical 
images, as aggregates of pixel intensity values, contain fer too much parallel information for 
a single viewer or user to mentally assess the quantification within the image. The viewer of 
digital medical image information who wishes to use the mathematical results of a 
quantitative analysis has no way of visually assessing how reliable, repeatable or accurate 
those results are by himself. Therefore evaluating and presenting a value for error in a 
quantified extracted result allows the user to assess the reliability of the results in a way 
which was not previously available to him. For this reason, the invention as described adds 
an nnportant contribution to the use of medical image analysis processes for the extraction of 
quantitative data. 

The invention is further es?)lained for those skilled in the art with the help of 

-^Oie^i^ewing-figises. 

Fig. 1 shows the normal process of imaging analysis which can be improved 

using the method of the invention. 

Fig. 2 shows the processes by which error influences the calculation of 
quantitative data, and how this process is then modeled according to the method of the 
invention. 

Fig. 3 shows the filling of a table of data, according to the method of the 

invention. 

Fig. 4 shows the extraction of data in the course of a real imaging analysis 
process to which the invention has been applied. 

Fig. 1 gives a gr^hical representation of the effect which arte&cts, imaging 
processes affect a quantitative image. Any such influencing process or parameter, pi, for 
example, is incorporated in an image analysis lA, 101, with tiie result that the ou^ut of that 
image analysis, i, becomes a function of the influencing parameter. So, for exao^le, 
numerous artefects such as noise, partial volume effect, and imaging processes such as 
registration may affect the image analysis as pi, p2 and p3. The resulting image is dependent 
on the values of these parameters and can be expressed as i(pi, p2, pa)- In the most general 
case, as shown in Fig. 1, the image is affected by an unquantified number of parameters, pN, 
and tiie resulting image can be expressed as i(pi, P2, • • • > Pn), or i(s)- 
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Fig. 2 gives a gr^hical lepiesentation of fhe modeling process utilized wifhin 
the invention. An ideal image, completely unaffected by arte&cts and containing no error 
introduced by the imagmg process, can be e?q>ressed as i(0,0,. . .,0), or i(Q^. If this is fed into 
the image modeling process IM, 201, it will result in a baseline value for the quantitative 
S result, QA(po). The important, or most influential, artefacts and imaging processes deemed to 
have an effect on the overall process of quantification act together to produce an image i(pi, 
P2, . . .,Pn)j which, if subject to the same image modeling process IM, 201, results in further 
quantitative result, QA(p). This quantitative result, QA(p), is inaccurate in that it deviates 
from the ideal result, QA(po)» and this difference A(s)^ can be measured as the difference 

10 between the two quantitative results, QA(po) and QA(p). 

Fig. 3 shows a method for constructing a table, according to the invention, by 
which the error which is introduced into the quantitative process by the parameters with the 
most influence can then be utilized to provide the user of the quantitative process with 
information according to the invention. Fig. 3 shows this using a sinqilified model utilizing 

15 only two parameters. 

Parameters, pi and p2, which influence the quantitative process can take 
different values. Normally the values would vary over a continuum, but for the purposes of 
modeling are restricted to discrete values pi(l), pi(2), pi(M) for pi and p2(l), P2(2), P2(M) for 
P2. Images containing all combinations of these values are then remodeled using the 

20 modeling processes developed so that quantitative resrilts QA(pi, p2) are produced for all 
combinations of values for pi and p2. These values all vary from the ideal quantitative result 
QA(po), where pi andp2 are both zero, by some difference, A(p), and these differences are 
then fed into a table 301 for future use. The form of the value representing this difference 
may be stored as the basic value of variation, or may be stored as a percentage difference or 

25 indeed in any other formulation which allows it to be used as a quantification of error. 

The case described above concerns only two parameters, pi andp2, and 
therefore shows a two dimensional table. A greater number of parameters would be stored in 
a table with the equivalent number of dimensions, as would be obvious to one skilled in the 
art. 

30 Fig. 4 shows the method of the invention as perceived by the end user. The 

various values of p and A(p) have been inserted into the table 401 from which the error, A(p), 
can be read out These results can now be applied to a real imaging session, 402, in which 
images for the purpose of quantitative analysis are produced. These images must be finther 
analyzed to estimate, or evaluate, the values of the influencing parameters, p, which are 
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incorpQiated into the image tesults of the real imaging session. This is easily done by Ihose 
skilled in the art using known techniques, and results in a series of values, pi(M) and p2(m), 
for example, which can be used to address the relevant value of error, A(e). In the case where 
the values attributed to p do not coincide completely with the values stored in the table, any 
interpolation or approximation method can be used, as would be apparent to those skilled in 
the art The value, A(p), can be presented to the user in any known way, to allow the user to 
assess the accuracy and reliability of the quantitative result of the medical image analysis 
process. 
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CLAIMB: 



1 . A medical image axialysis process which utilizes infoxmation contained in at 
least one medical image, in which a quantitative evaluation is denved £rom the medical 
image analysis process and delivered as an output, characterized in that the result of an error 
analysis, performed in order to provide information relating to the accuracy of the 

S quantitative evaluation, is also delivered as a further output 

2. A medical image analysis process, as claimed in Claim 1, characterized in that 
the error analysis comprises steps wherein 

an image artefact which contributes to the image analysis process is identified, 
10 the influence of the image artefect on the accuracy of the quantitative 

evaluation is calculated, 

the results of the calculation of the influence on the accuracy of the 
quantitative analysis is incorporated into the delivered fiirther output 

15 3. A medical image analysis process, as claimed in Claim 1, characterized in that 

the error analysis comprises steps wherein 

an image processing step which contributes to the image analysis process is 

identified, 

the influence of the image processing step on the accuracy of the quantitative 
20 evaluation is calculated, 

the results of the calculation of the influence on the accuracy of the 
quantitative analysis is incorporated into the delivered further output 

4. A medical image analysis process, as claimed in Claim 2 or Claim 3, 

25 characterized in that the results of the calculation of the influence on the accuracy of the 
quantitative analysis is stored prior to incorporation into the delivered output 
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5. A medicd image aiwlysis process, as claimed in Claim 4, chai^ 

the results of the calculation of the influence on the accuracy of the quantitative analysis is 
stoied in at least one of a multidimensional table, a look xxp table, or a foimula. 

5 6^ A medical image analysis process, as claimed in Claim 2, characterized in that, 

the identified image artefact which contributes to the image analysis process is at least one of 
noise, partial volume effect, sampling rate, inhomogeneity within the medical imaging 
process or an aite&ct due to patient motion. 

10 7. Amedicalimageanalysisprocess, as claimed in Claim 3, characterized in that, 

ihe identified image processmg step which contributes to the image analysis process is at 
least one of registration, ouHier classification, contour placement or segment placement 

8 A mfwti'-ff^ jryiafi** ariniygifl pmcftss, OS claimed in Claim 1 . characterized in tfiat, 

15 the medical iniage analysis process wMch utilizes information contained in the at least one 
medical image is the assessment of cardiac perfusion data, and the quantitative evaluation 
which is derived fixim the medical image anafysis process and delivered as an output is the 
myocardial perfusion resCTve index. 

20 9, A computer program, comprising instractions for a medical image analysis 

process which utilizes information contained in at least one medical image, and in which a 
quantitative evaluation is derived from the medical image analysis process and delivered as 
an oatpalt, characterized in that tiie computer program further comprises instructions wherein 
the result of an error analysis, performed in order to provide iDformation relating to the 

25 accuracy of the quantitative evaluation, is also delivered as a fiirther ou^ut. 

10. A workstation, conqnising mstractions for a medical image analysis process 

which utilizes infbrmation contained in at least one medical ima^ and in ^ch a 
quantitative evaluation is derived from the medical image analysis process and delivered as 
30 an output, characterized in that the workstation forflier conq?rises instractions vj^erein the 
result of an error analysis, performed in order to provide mformation relating to the accuracy 
of the quantitative evaluation, is also delivered as a further output 



PHNL030134EPP 

11 05.02.2003 

ABSTRACT: 



An invention is described wherein a medical image analysis process which 
utilizes information contained in at least one medical image and in which a quantitative 
evaluation is derived £rom the medical image analysis process and delivered as an output, 
also delivers as an output the result of an ^or analysis, performed in order to provide 
5 information relating to the accuracy of the quantitative evaluation. This error analysis may be 
based on an evaluation of the artefacts which have an effect on Ihe image. This error analysis 
may also be based on an evaluation of the imaging processes which have an effect on the 
image. 
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